# Multiple quantization versions
Longwriter Zero 32B I1 GGUF
Apache-2.0
The LongWriter-Zero-32B quantized model is based on the THU-KEG/LongWriter-Zero-32B base model, supports both Chinese and English, and is suitable for long context scenarios such as reinforcement learning and writing.
Large Language Model
Transformers Supports Multiple Languages

L
mradermacher
135
1
ICONNAI ICONN 1 GGUF
Other
Quantized version of ICONN-1, offering multiple quantization options to meet different performance and quality requirements
Large Language Model
I
bartowski
609
6
Wan2.1 14B VACE GGUF
Apache-2.0
The GGUF format version of the Wan2.1-VACE-14B model, mainly used for text-to-video generation tasks.
Text-to-Video
W
QuantStack
146.36k
139
Gte Qwen2 7B Instruct GGUF
Apache-2.0
A 7B-parameter multilingual text embedding model developed by Alibaba NLP team, specializing in sentence similarity tasks, offering multiple quantization versions
Large Language Model English
G
mradermacher
510
2
Heackmt5 ZhSum100k GGUF
Chinese abstract generation model based on mT5 architecture, offering multiple quantization versions
Text Generation Chinese
H
mradermacher
60
0
Deepthink Reasoning 7B GGUF
Openrail
The Llamacpp imatrix quantization version of Deepthink-Reasoning-7B, offering multiple quantization types to meet different hardware requirements.
Large Language Model English
D
bartowski
1,180
3
Aion RP Llama 3.1 8B GGUF
Apache-2.0
The Llamacpp imatrix quantization version of Aion-RP-Llama-3.1-8B, offering multiple quantization options to meet different hardware requirements.
Large Language Model
A
bartowski
159
1
Stable Diffusion 3.5 Large GGUF
Other
Stable Diffusion 3.5 Large is a powerful text-to-image generation model based on diffusion model architecture, capable of producing high-quality images from text descriptions.
Text-to-Image English
S
second-state
2,422
3
Qwen2.5 Coder 1.5B GGUF
Apache-2.0
Qwen2.5-Coder-1.5B is a code generation model with 1.5B parameters, supporting multiple programming languages and suitable for code completion and generation tasks.
Large Language Model
Transformers Supports Multiple Languages

Q
tensorblock
162
1
LLAMA 3 8B Unaligned BETA GGUF
An 8B-parameter unaligned beta model based on the LLaMA-3 architecture, offering multiple quantization versions to suit different hardware needs
Large Language Model
L
bartowski
542
10
Wizardlm 2 7B Abliterated GGUF
Apache-2.0
Llamacpp imatrix quantized version of WizardLM-2-7B-abliterated, offering multiple quantization options for different hardware configurations.
Large Language Model
W
bartowski
2,561
13
Orcamaid V3 13B 32k GGUF
Other
Orcamaid v3 13B 32K is a large language model based on the Llama architecture, supporting a sequence length of 32K and suitable for text generation tasks.
Large Language Model
Transformers

O
TheBloke
163
17
Opus V0 7B GGUF
Opus V0 7B is a 7B-parameter language model based on the Mistral architecture, developed by DreamGen, focusing on text generation tasks.
Large Language Model English
O
TheBloke
2,467
13
Featured Recommended AI Models